Data Insights Report 
Dr Richard Churches and Jan Lawrance 


How to assess 
the potential 
to teach 


New evidence from a STEM 
teacher assessment centre 
natotel-lmlam are telare 


| 

{2 
lEXeluter-\uloyel Bae 

)” Development Teaching Department 
Trust SCHOLARS for Education 


DATA INSIGHTS REPORT 


About the authors 


Dr Richard Churches is Lead Advisor for 
Education Reform and Evidence-Based 
Practice at Education Development 
Trust and Programme Director for 
Future Teaching Scholars. He has an 

MA in Education and a quantitative PhD 


Education Development Trust 


in leadership, organisational behaviour 
and psychology. Richard is also British 
Psychological Society Level A and B 
qualified in occupational testing! and has 
completed the OPP Assessment Centre 
Design Programme. 


Jan Lawrance is a Research Analyst at 
Education Development Trust. She has 
a BSc and MSc in Psychology and works 
across a wide range of areas conducting 
data analyses. 


and our Data Insights approach 


Education Development Trust is an 
international not-for-profit organisation 
that improves education systems 
internationally to transform lives, 
providing millions of people with greater 
opportunities to learn and thrive. We 
design and implement improvement 
programmes for school systems, deliver 


‘BPS Register of Qualifications in Test Use (RQTU) number: 221348. 


expert careers and employability 
services, and deploy specialists 

to provide consultancy services 
internationally. Our work is informed 
by our continually refreshed body of 
research and we invest annually in our 
programme of educational research. 


Foreword by Patrick Brazier 


Improving teaching quality is at the heart 
of what we do at Education Development 
Trust. We know that effective teaching 
starts with excellent teachers. Because of 
this recruiting and retaining high quality 
teachers has long been a key aim of 
education policies around the world. 


However, in many places, teacher 
recruitment targets have not been 
reached, especially in STEM subjects - 
and many trainee and newly qualified 
teachers leave the profession within 

a short period of time. This has real 
implications for student outcomes, which 
tend to be worse in schools with high staff 
turnover. More experienced teachers who 
have developed their practice tend to be 
more effective than newly qualified staff. 
Therefore, teacher retention — especially 
among new teachers — has to be about 
more than just ensuring adequate 
numbers: it also has implications for 
improving overall teaching quality. 


While there are many factors affecting 
teacher retention rates, one area we can 
consider, especially where early career 


teachers are concerned, is how we recruit 
and assess candidates for teacher training, 
and whether there are specific qualities 

or attributes which indicate how likely 
they are to remain in the profession. In 
this paper, we consider the evidence 

from our own assessment centres used to 
select candidates for our Future Teaching 
Scholars programme, and consider 

how the chosen applicants have fared 
throughout their teacher training. In doing 
so, our analysis offers lessons for teacher 
recruitment as part of teacher workforce 
reform. This is the first published 
evaluation of an education assessment 
centre, and the findings are fascinating 
and — in some cases - surprising. We 
hope that as a result, we can begin to lead 
the way in developing smarter recruitment 
and assessment strategies, thereby 
helping to ensure that more outstanding 
new teachers are recruited — and remain 
in the classroom for the long haul. 


Dr Patrick Brazier, 
Chief Executive Officer, 
Education Development Trust 


Education Development Trust Data Insights 
Reports provide high quality quantitative 
analyses and research insights from our 
portfolio of live programme delivery around 
the world. As such they are focused on 
practical questions related to delivery and 
the identification of evidence-informed 
solutions in the field. 
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The United Nations Educational, Scientific and 
Cultural Organisation (UNESCO) estimates that 
to achieve its education-related sustainable 
goal (SDG 4),? recruitment of 68.8 million 
teachers will be required (14.4 million primary 
teachers; 24.4 million secondary teachers). 


million 
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Quality teachers teach quality lessons - and 
quality lessons improve learner outcomes. 


In parallel, there is a crisis in teacher retention: 
almost as fast as we recruit teachers, we lose 
them early in their career.* 
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* Sustainable Development Goal 4: “Ensure inclusive and equitable quality education and promote lifelong learning opportunities for all.” UNESCO (2016). *Carver-Thomas and Darling-Hammond (2019), Mason and Matas (2015), OECD (2005; 2010; 2015). 
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The reasons behind the recruitment and retention challenge 
are complex - and the consequences are serious 


In England, workload can heavily influence 
a teacher's decision to leave teaching. 


e Early career teachers often make the 
decision to leave within the first three 
months of starting to teach. 


e There is much that can be done to reduce 
teachers’ workload without affecting pupils’ 
attainment,® and in turn, the personal 
characteristics of teachers seem important 
predictors of turnover.’ 


e High staff turnover constitutes a major 
drain on the resources available to develop 
a modern education system. 


In the United States alone, schools lose 
between $1 billion and $2.2 billion in 
attrition costs each year as a result of 
teachers moving or leaving the profession® 


1 ICICI nnn 
$1-$2.2 
billion 
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TO SCHOOLS IN THE US 
AS A RESULT OF TEACHERS 
MOVING OR LEAVING THE 

PROFESSION 


> CooperGibson (2018), Glazer (2018), Guarino et al. (2006). ®Churches (2020). ’Borman and Dowling (2008). ®Alliance for Excellent Education (2014). 
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Future Teaching Scholars and this data insights analysis 


related to the internal consistency 
(reliability), construct validity,“ 
and predictive validity? of the 
assessment centre. 


¢ Scholars also receive a conditional 
grant of £15,000. 


The Future Teaching Scholars programme 
is a six-year route into teaching.° 


e In the fourth year, Scholars join initial 
teacher training as an employed 


unqualified teacher. ; 
This Data Insights Report evaluates 


the assessment centre used as part 
of the Future Teaching Scholars 
selection process.” It contains findings 


e During three years of an undergraduate 
degree, Scholars undertake experiences 
in schools, alongside online learning, 
face-to-face training and conferences. 


e Following attainment of Qualified 
Teacher Status, they receive two further 
years of support to help their early 
career development. 


Teacher training Further support 


Undergraduate degree 


°www.futureteachingscholars.com. ‘Scholars are required to pay back their grant if they do not remain on the programme, enter the teaching profession and/or adhere to a stringent code of conduct. “Woodruff (2007). The Future Teaching Scholars assessment centre was designed 
with reference to British Psychological Society best practice guidelines (BPS, 2005) and was reviewed by independent chartered occupational psychologists before implementation (www.shirepro.co.uk). Education Development Trust (2016). “Internal consistency is a method for 
measuring reliability. It can help to judge how well items on a test (or a group of measures) produce comparable results when measuring the same construct. Construct validity is the extent to which a test or tool measures the construct it intends to measure. ' Predictive validity is the 
extent to which scores on a test (or scale) predict scores on a criterion (or performance) measure. 
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Assessment Centres 


Since their first use in the middle of e In the UK, a wide range of organisations However, as with all forms of important early in the use of an 
the twentieth century,”° recruiters make use of assessment centres.!® psychometric measurement, it is vital assessment centre, to check that 
and employers have seen assessment that the validity and reliability of such the approach is serving its intended 


e Assessment centres developed within 
applied and organisational psychology.” 
Organisations that use them often use 
this provenance to give their recruitment 
processes credibility. 


centres as effective tools for selection, 
promotion, the diagnosis of strengths 
and weaknesses and developing 
managerial competence.” 


processes is continuously evaluated purpose.’ 
in the new context in which they 
are being used. This is particularly 


The importance of conducting assessment 
centre research in education 


Education Development Trust designed e Well-designed assessment centres” are e It is not enough to assume the design A systematic review of the main education 

the Future Teaching Scholars programme more likely to produce data that can be of an individual assessment centre databases and other search systems” 

to include an assessment centre to help used to predict future performance than will achieve the same levels of validity showed that, despite increased use of 

ensure value for money. other forms of selection,” with a range of and reliability that previous centres assessment centres in education,** no 
notable levels of predictive validity.” have achieved.” studies of education assessment centre 


validity and reliability have been published. 


‘6Bray and Grant (1966). ‘” Lievens and Thornton (2005), Thornton and Rupp (2005), Povah and Thornton (2016), Woodruff (2007). ‘Such as IBM, BDO UK LLP, PWC, the RAF, MI5, Network Rail, Ernst and Young and the Civil Service Fast Stream (Bath Spa University, 2019). ‘Andersen et 
al. (2008), Cascio and Aguinis (2005). 2° British Psychological Society (2005). #4Cascio and Aguinis (2005). *Meriac et al. (2008). *3For example, .68 (Anderson and Cunningham-Snell, 2000); .53 (Gaughler et al., 1987); .37 (Schmidt and Hunter, 1988). Even at the lowest end of estimate 
(.37), such findings compare favourably with many medical treatments. In contrast, unstructured interviews have been found to be valid at levels between .11 and .33 (Anderson and Cunningham-Snell, 2000). **Smith (1994), Thornton and Gibbons (2009). **Australian Education Index 
(1977 - current), British Education Index (1975 - current), ERIC (1966 - current), Google Scholar, Web of Science. Search terms: education; assessment centre; recruitment, selection, teacher training. *°Such as Future Teaching Scholars [2016 to present], Fast Track Teaching assessment 
centre [2001 to 2009] (Churches, Hutchinson and Jones, 2010; Jones, 2008) and the Teach First assessment centre [2002 to present] (McConney, Price and Woods-McConney, 2012). 


Future Teaching Scholars is one of a series e Draw on what we know about the importance 


of Science, Technology, Engineering and of subject pedagogical knowledge in teaching 
Mathematics (STEM) recruitment and (teachers’ content knowledge and their ability 
retention strategies implemented by the to understand how students think about the 
Department for Education in England. subject and identify common misconceptions). 
Through the recruitment of people with e Recognise that this is mediated by other 
outstanding subject knowledge, Future important factors (quality of instruction, 
Teaching Scholars seeks to: classroom climate, classroom beliefs, 


professional behaviour). 
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77See www.futureteachingscholars.com for eligibility requirements. *°Coe et al. (2014). 
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Hypothesised importance of simulation 
within the assessment centre 


The classroom roleplay” aims to measure 
a candidate's innate ‘mental set’*’ prior to 
teacher training: 


e ‘With-it-ness’ 
The ability to monitor and quickly identify 
a potential problem and take action 


and 


¢ ‘Emotional objectivity’ 
Staying calm, not getting angry or 
becoming frustrated. 


Together, these areas are known to have 
a large positive effect on classroom 
management.*! 


The Future Teaching Scholars assessment 
centre is unique in that it includes 
serving subject-specific teachers from 
outstanding Teaching Schools as part of 
the assessment centre team. 


Future 
classroom 
management 
ability 


Emotional 


With-it-ness objectivity 


*2For the classroom roleplay, candidates will have prepared a short lesson. They teach this to two assessors (at least one of whom is a serving teacher). The assessors interject in the way that students might, so that the assessors can see the candidate's ability to respond in the moment 
to potentially frustrating situations (such as low level disruption and a student struggling to understand what is being taught). *7Marzano, Marzano and Pickering (2003). **d = 1.29 (ibid.). 
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The Future Teaching 
Scholars recruitment 
process uses twelve 


competencies and values 


to assess candidates: 


You as a scientist/mathematician: 

e Passion for mathematics or physics 

e Knowledge and skill in mathematics or 
physics 

e Initiative and problem-solving ability 

¢ Ability to explain mathematics and 
physics concepts 


You as a teacher: 
¢ Belief in the power of teaching to drive 
social change 
e Passion for working with young people 
e Ability to balance competing objectives 
e Understanding of the role of a teacher 


You as a person: 
e Empathy and/or cultural sensitivity 
e Perseverance in the face of challenges 
e Reliable, responsible and committed 
e Reflective and committed to self- 
improvement 
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During the day,” assessors grade 
candidates against ten of the 
competencies and values. Each of 
these ten competencies and values is 
evaluated twice within four activities:® 


Competency-based interview 

A 25-minute interview consisting of five 
standardised questions. Applicants have five 
minutes to read these questions before the 
interview begins. 


Classroom roleplay 

An eight-minute teaching episode assesses 
applicants’ ability to solve problems and to 
explain concepts in their subject. 


Reflection 

Applicants reflect on their classroom roleplay 
performance, evidencing their self-awareness 
and drive to improve, by talking about their 
strengths and areas for improvement. 


Group problem-solving exercise 

A group exercise assesses empathy, cultural 
sensitivity and problem-solving. Future Teaching 
Scholars uses a ‘collaborative’ problem-solving 
activity rather than a ‘competitive’ one, and 
therefore successful candidates are those who 
demonstrate the greatest ability to work with 
others effectively. 


A film about the assessment centre process was developed to support candidates in preparing for assessment. This can be viewed at: https://www.youtube.com/watch?v=2519loSxLB4. *3See Statistical Appendices: Table 1. “The decision whether to use a collaborative or competitive 
group activity as part of a selection process is a critically important one, which can have far reaching consequences once candidates are in post. 
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The current global 
challenges, as described 
earlier, and the approach 
chosen on Future Teaching 
Scholars, beg a number of 
important questions: 


‘What is the best way 
to assess teacher 
joXoha=sohmk-lmGoleld ele! 
terms of cognitive and 
non-cognitive traits, 
and retention)?’ 
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‘Can such traits 

be measured with 
validity and reliability 
in an assessment 


centre?’ 


‘If traits can be measured, 
do they predict teacher . 
effectiveness, student 

outcomes and retention 

over the short-, medium- 

and long-term’’ 
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ANALYSIS ONE ANALYSIS THREE ANALYSIS FOUR 


Internal consistency Predictive validity Comparison of teachers’ 
fod F-Yt-s coloyeeMol-taceyaert-beCe-miiana el 
expected levels for Qualified 
Teacher Status" 


ANALYSIS TWO 


Construct validity 


* Data for participants who attended the assessment centre from 2016 to 2019 was available (N = 329). We conducted the following analyses on this data and on classroom observation data available for the first cohort recruited in 2016, who are now serving teachers (n = 33). 

In terms of statistical power (a sample size sufficient to detect a significant effect), these results should be considered preliminary. Although we had access to data from 329 assessment centre participants, a wide range of recommendations are made with regard to sample size for 
effective factor analysis. Gorsuch (1983) recommend five subjects per item, with a minimum of 100 subjects. Guilford (1954) at least 200, while Cattell (1978) recommends three-to-six subjects per item, with minimum of 250. Comrey and Lee (1992) provide the following guidance in 
relation to the adequacy of sample sizes: 1000 or more = excellent, 500 = very good, 300 = good, 200 = fair, 100 = poor. *’ Power analysis, using G*Power (Faux et al, 2007; 2009) indicated that the serving teacher sample size would be sufficient to give 80% power to detect an r= .34 
effect as significant with alpha = .05 (two-tailed). **n = 33. *We used a 7-point scale adaption of the tool with the five written criteria for each item used as a rubric for the allocation of levels 1, 2, 3-4-5, 6 and 7, respectively. *°G*Power indicated that using a one sample sign test there 
would be 80% power to detect a d = 0.52 effect size as significant with alpha = .05 (two-tailed). ““Using a two-tailed one sample sign test. ** Department for Education (2013). **SCITT Qualified Teacher Status is only available in England. As with other initial teacher training, the quality 
of provision is regularly inspected by Ofsted. To be a Future Teaching Scholars SCITT, the training must be good or outstanding. 
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Findings 


Empathy and cultural awareness were 
strongly associated with candidates’ overall 
performance across the simulations,” 
alongside initiative and problem solving;® 


Both competencies were assessed during 
the classroom simulation and group 
problem-solving activities, further pointing 
to the potential value of such simulations 
in teacher recruitment. 


e Behavioural competence and the 
application of subject knowledge during 
simulations (Factor A); and 


Candidates’ thoughts (expressed during 

an interview) about joining the teaching 
profession and working with young people 
(Factor B).* 


Further, candidates who scored highly 

for empathy during the classroom and 
group problem-solving simulations were 
less likely to drop out of the programme 
prior to being employed in a school in their 
fourth year.” 


This is important, as other analyses show 
that these two clusters of data produce 
quite different findings on the prediction of 
later teacher performance in the classroom. 


“*We conducted a reliability analysis on the assessment centre scales including all 17 items. “°a = .88. Alpha decreased if we removed any items, 
showing that all competences are worthy of retention in future use of the assessment centre. For completeness, we then assessed the averaged 
repeated competencies (ten items). As before, this showed that the assessment centre had good reliability, with again, a decrease on deletion of 
any items. By convention values above .70 are considered acceptable, with those greater than .80 or .90 good or excellent, respectively (Nunnally, 
1978; Hair et al., 2006). “Exploratory factor analysis is not a single fixed approach and requires the researcher to make decisions about the analysis 
at critical stages in the process. Initially, we conducted a principal axis factoring analysis with oblique (promax) rotation on the averaged repeated 
indicators dataset, to avoid repeated indicators being over-represented. We used an oblique rotation as some correlation across factors was 
expected. An unrotated extraction of two factors accounted for 52.9% of the variance, with a correlation of .64. 47.94. 48.85. Other competencies 
making a significant contribution to Factor A included: passion for mathematics or physics (.63); ability to balance competing objectives (.62); ability 
to explain mathematics or physics concepts (.61). Three competencies made a significant contribution to Factor B: belief in the power of teaching 
to drive social change (.83); understanding the role of a teacher (.66); passion for working with young people (.53). Perseverance in the face of 
challenges approached making a significant contribution to Factor A (.59). *°A. Mann-Whitney test indicated that empathy and cultural awareness 
was greater for those remaining on the programme (Mean = 3.65) than for those who had withdrawn (Mean = 3.40), U = 2965.5, p =.016. The effect 
size for this difference was moderately large (d = 0.31). 
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Predictive validity” 


To help interpretation, we built an 
intercorrelation matrix.” Twelve 
correlations were significant, 
suggesting that the assessment 
centre competences may be 
predictive of twelve areas of teacher 
performance in the classroom. ”* 


Teachers’ ability to explain mathematical 
or scientific concepts (assessed during 
the assessment centre competence- 

based interview and classroom roleplay) 
predicted their later demonstration of high 
expectations, and their ability to structure 
learning, maximise learning time, respond 
to students’ answers, provide feedback 
and encourage discussion, as well as their 
ability to provide a variety of learning tasks 
that enable students to see, understand 


e In addition, teachers’ passion for 
mathematics and physics (measured 
during the competence-based interview 
and classroom roleplay) also predicted the 
effective use of learning time.°© 


Surprisingly, we found significant 
negative correlations between the 
teachers’ assessment centre scores 
related to passion for working with 
young people and four Teacher 
Practice Tool areas (assessed during 
the competence-based interview). 


This suggests that expressing a more 
fervent desire to work with young 
people at interview may, in fact, be 
an indication of a candidate who: 


e Later finds it more difficult to provide 


e May struggle with the continuous 
assessment of students.>” 


Looking beyond the significant 
correlations at the pattern of effects 
within the intercorrelation matrix: 


¢ Passion for working with young people 
scores were negatively correlated will 
all areas of the Teacher Practice Tool,*® 
reinforcing its lesser importance in the 
recruitment process, compared to 
observed behaviours and competence 
during simulations. 


e Similarly, understanding the role of a teacher 
(also assessed in the competence-based 
interview) negatively correlated with 
10 out of 11 Teacher Practice Tool areas.°° 


e Teachers’ passion for mathematics and physics 


of the Teacher Practice Tool. A similar 
pattern can be observed in relation to 
teachers’ abilities to explain maths or physics 
concepts. 


In summary, the predictive validity 
findings are potentially far-reaching 
because: 


e During recruitment interviews, teacher 


training programmes often put great store 
ona candidate's passion for working with 
children. 


e The predictive validity analysis suggests that 


recruiters should place more emphasis 
on the observation of a candidate's actual 
skills (during a classroom simulation and 
ability to reflect afterward), rather than 
the strength of their motivation to work 


and master the content they are learning.” with young people. 


learning tasks that engage and provide 


as a Subject correlated positively with all 
appropriate challenge for all students; 


Assessment centre scores for initiative and but one of the Teacher Practice Tool areas. 
problem-solving ability (assessed during 
the classroom roleplay and group activity) 
also predicted high expectations and 


maximisation of learning time. 


e By extension, this suggests that those 
who say they are most passionate about 
working with children may benefit from 
focused support to develop the ability to 
deliver in the classroom in a way most 
likely to yield better pupil outcomes. 


els not as effective at delivering a variety of 
learning tasks that enables students to see, 
understand and master the content they are 
learning (both in general and specifically 
related to their subject area); 


e Ability to reflect and show commitment 
to self-improvement (assessed during 
a post-classroom reflection interview), 
was positively correlated with all areas 


5° Predictive validity is the extent to which a score on a test or scale predicts scores on a criterion (or performance) measure. For example, the predictive validity of a cognitive ability test for job performance can be evaluated using the correlation between test scores and manager performance 
ratings. In this case, we would consider a cognitive test to have predictive validity if the observed correlations were significant. *See Statistical Appendices, Table 2. * = p < .05; ** = p< .01. The small number of significant effects was expected due to the small serving teacher sample size. 

As with the other analyses, more data will be added over time. ** Before looking at the ability of the assessment centre to predict teacher performance, we checked the internal consistency of the Teacher Practice Tool results. Alphas were as follows: overall, .97; creating a positive climate, .85; 
structuring and organising learning, .92; teaching through dialogue, .94; providing well designed learning tasks, .93; assessing learning continuously, .90. **r, = .49**, .43*, .39*, 39* and .40*, respectively. “r, = .37* and .40*, respectively. °r, = .38* 5’r, = -.43*, -.36*, -.35* and -.42*, respectively. 
58 With these effect sizes ranging from r, = -.10 to -.43. **The exception being the demonstration of high expectations (r, = .11). © The exception being continuously assessing students (r, = -.34). “With the range of effects from r, = .02 to .24. “All Teacher Practice Tool areas, r, = .10 to -.48. 
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Comparison of Scholars’ classroom 
performance with their peers* 


By the end of their first term in teaching, 
Scholars are already performing broadly in line 
with the performance expected of a teacher at 
the end of initial teacher training. This places 
Scholars, approximately one or two terms 
ahead of their peers.” 


In the following five areas of teacher practice, 
Scholars were significantly® in advance of other 
teachers completing Qualified Teacher Status at 
the end of their initial teacher training year: 


Structuring lessons well, 
Asking questions that engage students,” 


Asking questions that encourage students 
to think,® 


Responding to students’ answers, to provide 
feedback and encourage discussion,” 


Using learning tasks that engage and provide 
appropriate challenge for all students 
(all subjects). 


3 See effect size differences in the Statistical Appendices (Table 2). “It is difficult to disaggregate whether this enhanced performance is the result of the selection of a particular group of people, or the programme of support and experiences that a Scholar receives during their undergraduate 
years. However, the predictive validity data suggests that the Future Teaching Scholars assessment centre is able to predict some aspects of classroom performance even with a gap of three years between initial assessment and employment as a teacher. ©* = p< .05, **=p<.01, *** =p<.001. 
r= 0.32***, Cl (95%) = 0.15 - 0.46, d = 0.54. r= 0.33***, Cl (95%) = 0.12 - 0.49, d= 0.69. r= 0.24*, Cl (95%) = 0.01 - 0.43. d = 0.49. r= 0.25, Cl (95%) = 0.04 - 0.44, d= 0.52. r= 0.27%, Cl (95%) = 0.06 - 0.44, d = 0.55. 
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Conclusions 


The Future Teaching Scholars 


Assessment Centre appears to be: 


1. Valid and reliable 
suggesting that assessor 
training has ensured 
accurate measurement; 


In turn, although limited by the 
current sample size, the analyses 
suggest potentially far-reaching 
implications for teacher recruitment 
and training programmes: 


e Acandidate’s stated passion for working 
with children is often a focus for 
recruitment interviews. This research 
suggests recruiters should place 
more emphasis on the observation of 
a candidate's actual skills (during a 
classroom simulation and ability to reflect 


2. Able to make 
predictions about 
classroom performance 


years in advance ofa 
person being employed 
in aschool. afterward). 


e By extension, this implies that those who 
say they are most passionate about 
working with children may benefit 
from focused support to develop the 
ability to deliver in the classroom in 
a way most likely to yield better pupil 
outcomes. 
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We will continue to track Future Teaching Scholars 
until the end of their third year as a serving 
teacher. At that point, we will be able to make 
comparisons between their assessment centre 
scores and classroom performance, retention rates 
and student examination outcomes. 
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Assessment centres are time-consuming to design and expensive to run. Therefore, schools and middle-tier” organisations are unlikely to fully utilise them. 
However, the following insights from our research could help schools and other organisations to select teachers more effectively. 


In simulations during initial teacher 
training programme recruitment, 
looking for empathy and cultural 
awareness could be a helpful way 
to identify candidates who are more 
likely to remain in training. 


To draw out a candidate's ‘mental 
set’ classroom simulations should 
include elements where the 
‘learners’ are briefed in advance 
to provide unexpected challenge. 
Such challenges should require the 
candidate to demonstrate ‘with- 
it-ness’ and ‘emotional objectivity’ 
(e.g. repeatedly not understanding/ 
low-level disruption). The length 
of the simulation is probably less 
important than its quality. 


7 Such as multi-academy trusts, university departments, teacher training centres, local authorities etc. 
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Where a simulation is used, a clear 
scoring rubric should be written 
in advance, and the assessors 
(observers) should be carefully 
trained to apply it consistently. 


Serving teachers can effectively 
role-play learners. However, schools 
could find drawing on school pupils 
an effective approach (providing the 
children are well-trained and able to 
be consistent across candidates). 


To support teachers’ early 
development in the classroom, 
results from observations can be fed 
forward into teacher's development 
planning (e.g. through the 
identification of actions to support 
the development of weaknesses that 
were observed during selection). 
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The key elements of classroom simulation 


User 
feedback for 
development 

planning 


HOW TO ASSESS THE POTENTIAL TO TEACH 


Observed 
behaviours 


Challenge 
to assess 
‘with-it-ness’ 
and emotional 


F objectivity 
Consistent 
role playing 


Empathy 
assessed 
through what 
is seen rather 
than said 


\\ | i iW 
ve 


a: a iil 
| Yi; | 


i y) 


im aecbhek=tel 
(o) of=1-) aYA=) a) 


Statistical 
appendicies 


a —— _— — 


Competency- Classroom Reflection Group Paperwork 
based interview roleplay (post-classroom activity 
roleplay) 


You as a scientist/ Passion for mathematics or physics 
mathematician 
Knowledge and skill in mathematics or physics 
Initiative and problem-solving ability 
Ability to explain mathematics or physics concepts 
You as a teacher Belief in the power of teaching to drive social change 
Passion for working with young people 


Ability to balance competing objectives 


Understanding the role of a teacher 


You as a person Empathy and/or cultural sensitivity 


Perseverance in the face of challenges 
Reliable, responsible and committed 


Reflective and committed to self-improvement 
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Table 2: Intercorrelation matrix Teacher Practice Tool 
elements versus the ten competences and values 


assessed at the assessment centre’ 


YOU AS A SCIENTIST/MATHEMATICIAN YOU AS A TEACHER YOU AS A PERSON 
ASSESSMENT CENTRE COMPETENCIES Passion for _ Initiative Ability to Belief in the Passion for Ability to Understanding Empathy Perseverance Reflective and 
maths or and problem- explainmaths —_ power of working balance the role of a and/or inthe face of committed 
physics solving or physics teaching to drive with young competing teacher cultural challenges to self- 
ability concepts social change people objectives sensitivity improvement 
Creating a The teacher demonstrates high expectations 339 .374* 489** .0004 -.101 322 105 138 .218 244 
positive 
climate The teacher treats all students fairly .039 291 268 -.031 -.209 .029 -.094 .014 -.037 027 
The teacher recognises pupils with Special Educational .010 .083 104 -.092 -.343 -.118 -.105 -.093 .064 .030 
Needs and provides them with relevant support 
Structuring Lessons are well-structured 533 404* 425* .049 -.102 151 -.041 160 329 134 
and organising 
lessons Learning time is maximised .383* 342 .390* 035 -.101 169 -.080 235 279 126 
Teaching with — The teacher's explanations and instructions are clear 126 215 329 .074 -.199 137 -.076 -.039 .096 118 
dialogue 
The teacher asks questions in ways that engage students .038 212 138 .0003 -.194 = 142 -.048 -.043 197 .084 
The teacher asks questions that encourage students to think = .099 .063 224 150 -.303 .056 -.218 -.086 .078 136 
The teacher responds to students’ answers to provide .206 161 .389* 239 -.219 109 -.162 001 .020 164 
feedback and encourage discussion 
Providing Learning tasks engage and provide appropriate 047 146 264 -.031 -.426* -.030 «235 041 040 024 
well-designed — challenge for all students (all subjects) 
learning tasks 
The teacher provides a variety of learning tasks that 129 147 218 109 -.364* -.043 -.231 .086 014 .083 
enable students to see, understand and master the 
content they are learning (all subjects) 
The teacher provides a variety of learning tasks that 313 .203 .398* .040 -.348* 095 -.193 017 165 066 
enable students to see, understand and master the 
content they are learning (subject specific) 
Assessing The teacher continuously assesses students -.007 009 234 104 -.415* 013 -.335 Salis) -.081 023 
learning 
continuously 
Pe= 0 <.05,**=p<0l 
oan oan oan aH oan oan aH on aH a8 oan oan oa oan aH oa 2a aH on aH aH oan Sa 2H oan 


Table 3: Future Teacher Scholars’ classroom 
performance versus benchmark for a teacher 
passing Qualified Teacher Status 


EFFECT SIZE (r)* = Cl (95%) P-VALUE “ [d] 
Creating a The teacher demonstrates high expectations 0.228 -0.004 - 0.427 .054 0.404 
positive 
climate : 
The teacher treats all students fairly 0.240 -0.012 - 0.452 .060 0.422 
The teacher recognises pupils with Special Educational Needs and provides them with relevant support 0.183 -0.05 - 0.395 104 -.092 
Structuring Lessons are well-structured 0.318 0.147 - 0.464 002 0.535 
and organising 
lessons Learning time is maximised 0.167 -0.07 - 0.379 166 0.339 
Teaching with The teacher's explanations and instructions are clear 0.115 -0.165 - 0.370 432 0.231 
dialogue 
The teacher asks questions in ways that engage students 0.327 0.124 - 0.493 002 0.691 
The teacher asks questions that encourage students to think 0.236 0.012 - 0.429 .040 0.487 
The teacher responds to students’ answers to provide feedback and encourage discussion 0.253 0.040 - 0.435 020 0.523 
Learning tasks engage and provide appropriate challenge for all students (all subjects) 0.265 0.057 - 0.442 014 0.549 
Providing The teacher provides a variety of learning tasks that enable students to see, understand and master the content they are learning (all subjects) 0.206 -0.028 - 0.409 084 0.420 
well-designed 
deanningyashs The teacher provides a variety of learning tasks that enable students to see, understand and master the content they are learning (mathematics) 0.123 -0.104 - 0.332 292 0.247 
The teacher provides a variety of learning tasks that enable students to see, understand and master the content they are learning (physics) 0.022 -0.026 - 0.069 376 0.044 
Assessing The teacher continuously assesses students 0.203 -0.019 - 0.398 072 0.415 


learning 
continuously 


We have reported a non-parametric equivalent of Cohen's d because of the distribution (Rosenthal, 1994). Two-tailed one sample sign test. 
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Education Development Trust's large scale delivery is underpinned by evidence and 
research. As a registered charity, we reinvest a percentage of our surplus into a publicly 
available programme of educational research. We also invest in an ongoing Research and 
Development cycle to rigorously review the impact of our own programmes, generate 
new evidence on what works, and share insights to support broader debate and policy. 


The evidence and insights shared in this handbook are part of this ongoing commitment 
to Research and Development. 
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